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Computer-Aided Detection Methods in Volumetric Imagery 

CROSS-REFERENCE TO RELATED APPLICATIONS 

5 This application claims the benefit of U.S. Provisional Application No. 

60/391,120, filed June 24, 2002, incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

1 0 This invention relates to a method and system for computer-aided detection 

(CAD) of volumetric images, specifically for detection of polyps indicative of colon 
cancer in computed tomography imagery. 

2. Discussion of Background 

1 5 Colorectal cancer is the second leading cause of cancer death in the United States. 

Each year approximately 150,000 people are diagnosed with colon cancer and 56,000 
people die from it. Colonoscopic removal of identifiable polyps can considerably 
decrease the mortality. However, current screening methods of fiberoptic colonoscopy, 
flexible sigmoidoscopy, fecal occult blood testing and barium enema examination carry 

20 varying amounts of risk and may cause considerable discomfort to the patient, and 
therefore are not widely accepted by the general population. Recently, non-invasive 
virtual colonoscopy (VC) systems using computed tomography (CT) images were 
introduced as a colon cancer screening method and several commercial systems have 
been approved by the FDA. 

25 In a VC system, prone and supine CT views of air-filled and cleansed colon are 

acquired and displayed in two dimensions (2D) and in three dimensions (3D). Two- 
dimensional displays are usually transverse images of CT slices as well as sagittal and 
coronal reformations. Three-dimensional displays could be volume renderings of 
suspicious regions or endoluminal representations. 

30 Because of the large number of images that need to be examined in 2D views 

(300-700 images/patient) and the relatively long time it takes to do an endoluminal "fly- 
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through," virtual colonoscopy interpretation can be quite time-consuming, typically 
ranging from 15 to 40 minutes when performed by experts in abdominal imaging. 
Additionally, the main task of identifying polyps can be challenging. Different studies 
report a large variation in sensitivity and specificity for the same dataset. This variation 
5 can be partly attributed to the operator's learning curve with the VC system. A CAD 
system can help users of VC systems by indicating the locations and reporting the 
characteristics of potential polyps. Such a system may increase the sensitivity while not 
decreasing the specificity. 

10 It is therefore an object of this invention to provide a method and system for the 

automated detection of abnormal lesions in volumetric imagery. 

SUMMARY OF THE INVENTION 
1 5 In accordance with one aspect of the invention, a method of detecting 

abnormalities in digital imagery is provided comprising the steps of: providing a set of 
binary images derived from a plurality of slice images representing cross-sections 
through a body; performing a first spherical summation operation as a function of voxel 
locations in the set of images to provide a first spherical summation value; performing a 
20 second spherical summation operation as a function of the voxel locations in the set of 
images to provide a second spherical summation value; computing a ratio of the first 
spherical summation value to the second spherical summation value; and comparing the 
ratio to a threshold value and creating a set of detection images by turning voxels ON 
which exceed the threshold value. 

25 

Other objects and advantages of the invention will be apparent from the following 
description, the accompanying drawings and the appended claims. 



30 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is an overview of a computer-aided detection system incorporating the present 
invention. 
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FIG. 2 shows the abnormality detector of the present invention. 
FIG. 3 illustrates the spherical summation operation. 

FIG. 4 is a detailed block diagram of the abnormality detector incorporating the spherical 
summation operator. 
5 FIGS. 5-7 illustrate example outputs from the abnormality detector. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
CAD systems typically follow a coarse-to-fine approach. That is, many potential 
abnormalities are found in an initial detection algorithm of relatively low computational 
10 complexity. Then, the initial detections are screened, and surviving detections are 
subjected to further more computationally expensive stages to successively prune 
spurious detections. Several CT CAD systems known in the art are described in U.S. 
Patent No.'s 6,556,696; 6,466,687; 6,246,784; and published U.S. Patent Application 
2002/0141627. 

1 5 Computer-aided detection systems are generally composed of the fundamental 

modules shown in FIG. 1. In a preprocessing stage, 50, the imagery, 1, may be cropped 
to reduce the amount of data to be processed and filtered to enhance the structures to be 
identified. In the next stage of a CAD system, a detector, 100, is applied. The purpose 
of the detector is to identify a set of initial detections, 199. A screening classifier, 200, 

20 reduces this set of initial detections to retain only those that are most likely to be of 
subsequent interest. The surviving detections are input to following feature extraction 
and classification stages, 300 and 400. Ultimately, the CAD system produces a set of 
final detections, 500. This invention presents a method for providing initial detections 
designated, 199 within the dashed box of FIG 1. 

25 The detection method of this invention is efficient to compute and is based on 

simple summations. Summation is an integral process and provides a degree of noise 
immunity. In contrast, detectors based on curvature calculations use derivative processes. 
Therefore, they are more susceptible to produce spurious outputs due to noise in the input 
imagery. Reduction of spurious outputs from the detector provides the benefits of 

30 decreased processing time in subsequent stages and potentially greater overall 
classification accuracy. 
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3-Dimensional Imagery 
Assume the rectangular coordinate system with axes k), where are in 
the horizontal plane and k is oriented vertically upwards, A point in space can be 
identified by specifying an (x, y, z) values for the corresponding (/ j, k) directions. A 
5 volume of space may be considered to be comprised of solid rectangular volume 
elements, or voxels. 3-dimensional imagery is specified by providing a set of voxel 
values over a region of space. In a set of CT imagery, the k direction is typically oriented 
along the head-to-foot axis. A two-dimensional transverse image, or slice, is obtained by 
selecting a particular value of z, then retaining all voxel values in the (/, j) directions. 
10 Values in 2-dimensional images are referred to as pixels. 

Segmentation 

Voxel values in CT imagery are in Hounsfield units. Different types of tissue are 
represented within selected intervals of Hounsfield units. Furthermore, air-filled regions 

1 5 provide different values Hounsfield units than most regions of tissue. Since the colon is a 
hollow organ, and since it is inflated with air before the CT exam for virtual colonoscopy, 
it may be initially segmented in CT imagery by identifying voxels with values associated 
with air. In CT imagery, a mask may be used to identify objects of interest within the 
slice images. A mask is a binary image wherein locations of ON pixels indicate locations 

20 of tissue in the corresponding input image. Colon masks may be created by segmentation 
methods. Segmentation methods are known in the art, see for example Chen et al, U.S 
Patent No. 6246784 and published U.S. Patent Applications 2001/0055016 and 
2001/0044576. 

25 DETECTION 

An overview of the detection process is shown in FIG. 2. A set of CT images, 1, 
is input to step 1 10 where the colon is segmented. The segmentation step produces a set 
of binary colon masks, 120. The binary colon masks are input to step 140, where 
summations over spherical volumes with two different radii are computed. Abnormalities 

30 are detected based on a feature computed for every pixel location as a function of the 
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spherical summation values. A set of initial detections, 199, is created based on the 
feature's value. 

FIG. 3 illustrates the application of the spherical summation operator. Let 121- 
129 represent binary colon masks. The shaded regions represent colon areas within the 
CT imagery and are assigned the value of -1 . In FIG. 3, only masks 121 and 122 contain 
colon areas. Unshaded regions are outside the colon and are assigned the value of +1 . A 
spherical template, 1 3 1 is centered at voxel location (jc, y 9 z\ In FIG. 3, z denotes the 
slice index, and the pair (y, x) denotes the row and column coordinates for the center of 
the spherical template. The sphere is shown centered at location (x,y) on mask 126. 
The radius, R, of the sphere in the illustrated example of FIG. 3 is equal to two units. 
Therefore, the summation involves masks 124 through 128. It should be understood that 
the detector of the present invention incorporates two values of the radius R, i.e. Ri = 2 
and R2 = 4, as will be described below. 

The spherical summation operator is the fundamental computation of the detector. 
The purpose of the operator is to compute the sum of voxel values within a given distance 
of a specified point. Let a voxel be located at (x, y, z\ the distance be 7?, and voxels be 
obtained from a set of input masks denoted by 9*. 

The first step is to identify the set of voxel locations to be included in the 
summation. Let a voxel located within the distance be represented by / = {a,b,c\ and the 
set of voxels be denoted as T. That is, 



FIG. 4 shows a block diagram illustrating the detection method. Detection begins 
by operating on the set of colon masks, 120. Each colon mask has pixel values of -1 at 
the air-filled regions inside the colon. Correspondingly, pixel values of +1 represent 
regions of tissue outside the colon. In step 132, the spherical summation operator is 




t = (a, 6, c) 



Then, the spherical summation may be written as 



S R (x,y,z) = Y,M(0 



teT 
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applied with a predetermined radius, R|, at the voxel location (x, y y z), producing the 
spherical sum, Sri(x, y, z), 134. In step 136 the spherical summation operator is applied 
with a predetermined radius, R 2 , at the voxel location (x, y, z), producing the spherical 
sum Sr2(x, y, z), 138. In step 141, Sri (x, y, z) is divided by Sr2(jc, y, z) to produce 
5 Ratio(x, y, z), 142. In step 144, the value of the ratio is compared to a predetermined 
threshold value, 0, to determine if the voxel associated with location (x, y, z) should be 
considered a detection. The spherical summation is computed for all (x, y, z) of the input 
imagery. 

A set of initial detections, 199, is created as follows. First, an output array 
10 corresponding to the detection images is initialized such that all voxels are turned 'OFF'. 
Then, if the value of Ratio(x, y, z), is greater than 0, the voxel at location (x, y, z) in the 
output array is set to 'ON'. Preferred values for predetermined parameters are: Ri = 4; 
R 2 = 2, and 0 = 55. 

1 5 Example Outputs 

To demonstrate the utility of the present invention, FIGS. 5- 7 show a set of 
detector outputs on transverse slices from CT imagery. The outline of the colon is 
divided into three objects on these slices. Separate objects appear in these transverse 
views due to vertical trajectories of the colon. Circles represent detections found by the 

20 method of the present invention and rectangles represent areas of visually identified 
polyps. The utility of the present invention is confirmed by noting detections within 
regions identified as polyps. 

What is claimed is: 
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